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@ Pattern defect Inspection method and apparatus. 



© The pattern edge direction in reference image 
data of an object to be examined is detected, the 
reference image data is differentiated using a dif- 
ferential operator in a direction along the pattern 
edge direction, and inspection image data obtained 
by picking up an image of the object to be inspected 
is differentiated using the differential operator in the 



direction along the pattern edge direction. The dif- 
ferential data obtained by the differential processing 
are compared with the inspection image data, and a 
pattern defect on the object to be inspected is 
detected based on the difference between these 
data. 
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The present invention relates to a pattern de- 
fect inspection method and apparatus for defecting 
a defect of an object to be inspected by comparing 
reference image data and inspection image data 
obtained by optically scanning the object to be 
inspected. 

For example, the inspection process of semi- 
conductor masks or printed circuit boards in a 
semiconductor manufacturing factory is needed for 
guarantee the quality of the product. In this inspec- 
tion process, it must be inspected whether or not a 
pattern on a manufactured semiconductor mask or 
printed circuit board coincides with a design pat- 
tern. 

This automatic inspection process is performed 
as follows. 

An inspection pattern on a semiconductor 
mask or a printed circuit board as an object to be 
measured is read by an image sensor to obtain 
two-dimensional inspection image data. 

It is checked if the inspection image data co- 
incides with reference image data of a reference 
pattern obtained from design data. 

As a result of this checking, if the inspection 
image data does not coincide with the reference 
pattern, a defect signal is output, and a defect 
position on the inspection pattern is specified. 

FIG. 1 is a block diagram of such a pattern 
defect inspection apparatus. 

An image sensor 1 scans an object to be 
inspected, and outputs the image signal. The im- 
age signal is converted into digital multi-value data 
corresponding to, e.g., 11 density levels "0" to 
"10" by an A/D converter 2. 

With this conversion, two-dimensional inspec- 
tion image data is generated. The inspection image 
data corresponds to an inspection pattern on the 
object to be inspected, and is supplied to a first 
differential circuit 3. 

The first differential circuit 3 has differential 
operators respectively in x (horizontal), y (vertical), 
+ 45°, and -45* directions shown in FIGS. 2A to 
2D. 

The x and y directions are orthogonal direc- 
tions. The ±45° directions define angles with re- 
spect to the x direction. 

The first differential circuit 3 spatially differen- 
tiates the inspection image data using these dif- 
ferential operators in the four differential directions, 
and sends differential results to a selector 4. 

On the other hand, a design data memory 5 
stores a design pattern date generated based on a 
design value (AD data). 

A reference image generator 6 converts the 
design pattern data into digital multi-value data 
corresponding to, e.g., 11 density levels "0 W to 
"10", and supplies the conversion result to a sec- 
ond differential circuit 7 as reference image data. 
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The second differential circuit 7 has the same 
differential operators as in the first differential cir- 
cuit 3, i.e., differential operators respectively in the 
x (horizontal), y (vertical), +45*, and -45" direc- 
5 tions. 

The second differential circuit 7 spatially dif- 
ferentiates the reference image data using these 
four differential operators, and sends differential 
results to a minimum value direction detection cir- 
10 cuit 8. 

A case will be exemplified below wherein the 
inspection image data is as shown in FIG. 3. 

Inspection image data 20 (FIG. 3) is defined by 
a plurality of pixel data 21 . A pattern 22 is defined 
is by the level values of these pixel data 21. 

Each of local areas 23 is defined by 3 x 3, i.e., 
a total of nine pixel data 21 . 

Of these areas, the local area 23 at a position 
A is located at an edge portion of the pattern 22. 
20 The local area 23 at a position B is located at a 
corner portion of the pattern 22. The local area at a 
position C is located at a uniform portion other than 
the pattern 22. 

For example, pixel data in the local area 23 at 
25 the position A has a smooth density gradation, as 
shown in FIG. 4. This local area 23 consists of 5 x 
5 pixel data. Numerical values of these pixel data 
indicate multi-value density levels. 

Differential processing for the inspection image 
30 data shown in FIG. 4 using a differential operator 
Db in the y direction shown in FIG. 2B is as 
follows. 

Of the pixel data 21 shown in FIG. 4, a dif- 
ferential value in the y direction for each of central 
35 density levels "5" corresponds to the difference 
"4" between two pixel data "7" and "3" adjacent to 
the density level "5" in the y direction. 

More specifically, this differential value repre- 
sents a slope defined by neighboring pixel data in 
40 the differential direction, i.e., the y direction. 

Therefore, the first and second differential cir- 
cuits 3 and 7 calculate differential values in the 
above-mentioned four directions in units of pixel 
data. 

45 For example, when the differential values in the 

four directions are calculated for each of all pixel 
data constituting image data, the relationship be- 
tween a pattern (original image) of image data and 
the differential values is as follows. 

50 More specifically, the original image has an 

edge in the y direction, as shown in FIG. 5. When 
this original image is differentiated in the respective 
directions, the differential value in the x direction 
assumes a maximum value, and the differential 

55 value in the y direction assumes a minimum value 
"0", as shown in FIG. 6. 

Note that the differential values in the +45° 
and -45° directions assume small values as com- 
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pared to the differential value in the x direction. 

The original image includes a defect G near 
the edge, as shown in FIG: 7. The defect G pro- 
jects in the x direction. 

In the differential value in the x direction for 
this original image, a discontinuous portion is gen- 
erated in the x direction at the position of the 
defect G, as shown in FIG. 8. 

On the other hand, in the differential value in 
the y direction, a value other than n 0" correspond- 
ing to the defect G is generated. In the ±45° 
directions, differential values resulting from the de- 
fect G are generated. 

Therefore, as can be seen from a comparison 
between the differential results shown in FIGS. 6 
and 8, the differential direction in which the dif- 
ferential value largely changes due to the presence 
of the defect G is the y direction. 

If the original image shown in FIG. 5 is as- 
sumed to be reference image data and the original 
image shown in FIG. 7 is assumed to be inspection 
image data, of the differential values in the respec- 
tive directions for the reference image data, the 
differential value in the y direction assumes a mini- 
mum value. 

The minimum value direction detection circuit 8 
receives the differential values (absolute values) in 
the respective directions from the second differen- 
tial circuit 7, and detects the differential direction 
corresponding to the smallest one of the received 
differential values (the y direction in this case). The 
circuit 8 supplies the y direction to the selector 4. 

The selector 4 receives the differential values 
in the four directions from the first differential cir- 
cuit 3, selects the differential value in the y direc- 
tion designated by the minimum value direction 
detection circuit 8 from the received differential 
values, and sends the differential value in the y 
direction to a defect judge circuit (discrimination 
circuit) 9. 

The defect judge circuit 9 compares the input 
differential value with a predetermined threshold 
value, and when the differential value exceeds the 
threshold value, the circuit 9 determines that the 
pattern defect G is present in the pixel data cor- 
responding to this differential value. 

A direct comparison circuit 10 directly com- 
pares pixel data which are not differentiated. 

The direct comparison circuit 10 calculates dif- 
ference data between each pixel data in the in- 
spection image data and the corresponding pixel 
data in the reference image data. 

A defect judge circuit 1 1 compares each of the 
difference data from the direct comparison circuit 
10 with a threshold value. When the difference data 
exceeds the threshold value, the defect judge cir- 
cuit 11 determines that a pattern defect is present 
in this pixel data. 



On the other hand, FIG. 9A shows a differential 
value for the uniform portion (FIG. 3A) at the posi- 
tion C input to the defect judge circuit 9. This 
uniform portion includes a defect Ga. 

5 All the differential values, in the respective di- 

rections, of the reference image data of this uni- 
form portion are "0" and are equal to each other. 
For example, a maximum value of differential val- 
ues in the x and y directions is calculated. Then, 

10 the reference pattern is compared with the maxi- 
mum value. Thus, the defect Ga included in the 
uniform portion can be clearly detected. 

In general, when a pattern defect is detected 
by comparing an inspection pattern and a refer- 

is ence pattern, the position or pattern coordinates of 
inspection image data and reference image data 
must be set to perfectly coincide with each other. 

If the position or pattern coordinates of these 
data are shifted from each other, pixel data at 

20 different positions are compared with each other. 
With this comparison, a pattern defect cannot be 
clearly detected. 

In order to prevent the false defect due to the 
position mismatch between the image data, the first 

25 and second differential circuits 3 and 7 compare 
differential values in the respective directions. 

More specifically, inspection image data and 
reference image data are shifted by At in the x 
direction, as shown in FIG. 9B. In this case, even if 

30 no defect Gb is present at all, the entire area, in 
the vertical direction, of the width At is detected as 
a pattern defect as a result of defect detection of 
the direct comparison circuit 10. 

When the reference image data and the in- 

35 spection image data which are shifted by At from 
each other are differentiated in the respective di- 
rections, the differential value in the x direction 
changes at the edge portion of the pattern, but the 
differential value in the y direction does not change 

AO from "0". 

Therefore, based on the differential value n 0 n 
in the y direction, even when the reference image 
data and the inspection image data are shifted by 
At from each other, the pattern edge portion is not 

45 detected as a defect. 

On the other hand, when a defect Gb is 
present, as shown in FIG. 9B, the differential value, 
in the y direction, of the inspection image data 
assumes a value corresponding to the defect Gb. 

so The defect judge circuit 9 detects a pattern defect 
from this differential value. 

In this manner, even when the position or pat- 
tern coordinates of the inspection image data and 
the reference image data do not perfectly coincide 

55 with each other, a pattern defect is detected. 

However, in the corner portion at the position B 
in FIG. 3, as shown in FIGS. 10A and 10B, a shift 
portion of the width At is detected as a false defect 



3DOCID: <EP 0643293A1_I_> 



5 



EP 0 643 293 A1 



6 



Gc. 

More specifically, in the corner portion, the 
differential values in the -45" direction have some 
small value, and the differential values in the re- 
maining directions has bigger value. 

If the position or pattern coordinates are shifted 
from each other, the minimum differential value 
directions of the inspection image data and the 
reference image data with respect to pixel data do 
not coincide with each other. 

As a result, although the selector 4 selects the 
differential value in the differential direction des- 
ignated by the minimum value direction detection 
circuit 8, the selected differential value is not "0" 
but has a value corresponding to the shift width At. 

Therefore, when this differential value exceeds 
a threshold value, the defect judge circuit 9 detects 
a pattern defect. 

On the other hand, when the corner portion 
includes a defect Gd, as shown in FIG. 10B, the 
differential value corresponding to this defect Gd is 
selected by the selector 4. The defect judge circuit 
9 detects the differential value corresponding to 
this defect Gd as a pattern defect Ge. 

For this reason, the pattern defect Ge resulting 
from the defect Gd is detected in the same manner 
as the false defect Gc due to the shift width At. 

Therefore, whether the defect Gd is actually 
present or the pattern defect Gc is detected due to 
the position mismatch cannot be distinguished from 
each other. 

It is an object of the present invention to pro- 
vide a pattern defect inspection method, which can 
accurately detect only a pattern defect even when 
the position or pattern coordinates of inspection 
image data and reference image data are slightly 
shifted from each other, and can improve defect 
detection accuracy and defect detection reliability. 

It is another object of the present invention to 
provide a pattern defect inspection apparatus, 
which can accurately detect only a pattern defect 
even when the position or pattern coordinates of 
inspection image data and reference image data 
are slightly shifted from each other, and can im- 
prove defect detection accuracy and defect detec- 
tion reliability. 

According to the present invention, a pattern 
edge direction in reference image data for pattern 
defect detection of an object to be inspected is 
detected, reference image data is differentiated us- 
ing a differential operator in a direction along the 
detected pattern edge direction, and inspection im- 
age data obtained by scanning an image of the 
object to be inspected is differentiated using the 
differential operator in the direction along the de- 
tected pattern edge direction. The differential data 
obtained by the differential processing are com- 
pared with the inspection image data, and a pattern 
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defect on the object to be inspected is detected on 
the basis of the difference between these data. 

According to the present invention, there is 
provided a pattern defect inspection apparatus 

5 comprising: image pickup means for picking up an 
image of an object to be inspected to generate 
inspection image data; reference image generation 
means for generating reference image data for 
comparing with the inspecting pattern on the ob- 

io ject; edge direction detection means for detecting a 
pattern edge direction in the reference image data; 
first edge direction differential means for executing 
differential processing of the inspection image data 
using a differential operator in a direction along the 

is pattern edge direction; second edge direction dif- 
ferential means for executing differential processing 
of the reference image data using the differential 
operator in the direction along the pattern edge 
direction; differential processing means for execut- 

20 ing differential processing of surrounding pixels in 
the reference image data using the differential op- 
erator in the direction along the pattern edge direc- 
tion, and executing differential processing of the 
reference image data using differential operators in 

25 directions neighboring the pattern edge direction; 
and discrimination means for detecting a pattern 
defect of the object to be inspected on the basis of 
a difference between difference data obtained by 
the first edge direction differential means, and dif- 

30 ferential data obtained by the second edge direc- 
tion differential means or at least one of differential 
data obtained by the differential processing means. 

According to the above-mentioned apparatus, 
inspection image data is generated by scanning an 

35 image of an object to be inspected, and reference 
image data of the object to be inspected is gen- 
erated. Of these data, a pattern edge direction in 
the reference image data is detected. The inspec- 
tion image data is differentiated using a differential 

40 operator along the detected pattern edge direction, 
and the reference image data is also differentiated 
using the differential operator along the detected 
pattern edge direction. Furthermore, surrounding 
pixels of the reference image data are differen- 

45 tiated using a differential operator in a direction 
along the pattern edge direction, and are differen- 
tiated using differential operators in directions 
neighboring the pattern edge direction. Then, a 
pattern defect of the object to be inspected is 

so discriminated on the basis of the difference be- 
tween the differential value for the inspection image 
data and at least one differential value of those for 
the reference image data. 

This invention can be more fully understood 

55 from the following detailed description when taken 
in conjunction with the accompanying drawings, in 
which: 
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FIG. 1 is a block diagram showing the arrange- 
ment of a conventional pattern defect detection 
apparatus; 

FIG. 2A is a view showing a differential operator 
in the x direction; 5 
FIG. 2B is a view showing a differential operator 
in the y direction; 

FIG. 2C is a view showing a-differential operator 
in the +45° direction; 

FIG. 2D is a view showing a differential operator 10 
in the -45° direction; 

FIG. 3 is a view showing inspection image data 
corresponding to edge, corner, and uniform por- 
tions; 

FIG. 4 is a view showing the inspection image is 
data of the edge portion; 

FIG. 5 is a view showing an original image 
without a defect; 

FIG. 6 is a view showing the differential values 
of the original image; 20 
FIG. 7 is a view showing an original image with 
a defect; 

FIG. 8 is a view showing the differential values 
of the original image; 

FIG. 9A is a view showing the defect detection 25 
result of the uniform portion when a coordinate 
shift occurs; 

FIG. 9B is a view showing the defect detection 
result of the edge portion when a coordinate 
shift occurs; 30 
FIG. 1 0A is a view showing the defect detection 
result of a comer portion when a coordinate shift 
occurs; 

FIG. 1 0B is a view showing the defect detection 
result of a corner portion with a defect when a 35 
coordinate shift occurs; 

FIG. 11 is a block diagram showing the arrange- 
ment of a pattern defect inspection apparatus as 
a premise of the present invention; 
FIG. 12 is a view showing differential results in 40 
respective differential directions; 
FIG. 13A is a view showing the differential direc- 
tion and differential value of an edge portion; 
FIG. 13B is a view showing the differential direc- 
tion and differential value of a corner portion; 45 
FIG. 13C is a view showing the differential direc- 
tion and differential value of a uniform portion; 
FIG. 14A is a view showing the comparison 
result of a normal corner portion; 
FIG. 14B is a view showing the comparison 50 
result of a corner portion with a defect; 
FIG. 15 is a block diagram showing a pattern 
defect inspection apparatus according to an em- 
bodiment of the present invention; 
FIG. 16A is a view showing a differential oper- 55 
ator in the +22.5* direction; 
FIG. 16B is a view showing a differential oper- 
ator in the +67.5" direction; 



FIG. 16C is a view showing a differentia! oper- 
ator in the -22.5 - direction; 
FIG. 16D is a view showing a differential oper- 
ator in the -67.5* direction; 
FIG. 17 is a view showing reference image data 
including edge, corner, and uniform portions; 
FIG. 18 is a view showing the density values of 
the edge, corner, and uniform portions in the 
reference image data; 

FIG. 19 is a view showing inspection image data 
without a defect; 

FIG. 20 is a view showing the density values of 
edge, corner, and uniform portions in the in- 
spection image data; 

FIG. 21 is a view showing inspection image data 
with a defect; 

FIG. 22 is a view showing the density values of 
edge, corner, and uniform portions in the in- 
spection image data with a defect; 
FIG. 23 is a view showing the edge direction of 
the reference image data; 

FIG. 24A is a view showing the differential value 
of the inspection image data without a defect; 
FIG. 24B is a view showing the differential value 
of the inspection image data with a defect; 
FIG. 25A is a view showing the differential value, 
in the edge direction, of the reference image 
data; 

FIG. 25B is a view showing the differential value 
of surrounding pixels of the reference image 
data; 

FIG. 25C is a view showing the differential val- 
ues, in neighboring directions, of the reference 
image data; 

FIG. 26A is a view showing the subtraction re- 
sult, in the edge direction, of the inspection 
image data without a defect; 
FIG. 26B is a view showing the subtraction re- 
sult of surrounding pixels of the inspection im- 
age data without a defect; 
FIG. 26C is a view showing the subtraction 
result, in neighboring directions, of the inspec- 
tion image data without a defect; 
FIG. 27A is a view showing the subtraction re- 
sult, in the edge direction, of the inspection 
image data with a defect; 

FIG. 27B is a view showing the subtraction re- 
sult of surrounding pixels of the inspection im- 
age data with a defect; 

FIG. 27C is a view showing the subtraction 
result, in neighboring directions, of the inspec- 
tion image data with a defect; 
FIG. 28 is a view showing the edge direction of 
the reference image data; 

FIG. 29A is a view showing the differential value 
of the inspection image data without a defect; 
FIG. 29B is a view showing the differential value 
of the inspection image data with a defect; 
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FIG. 30A is a view showing the differential value, 
in the edge direction, of the reference image 
data; 

FIG. 30B is a view showing the differential value 
of surrounding pixels of the reference image 
data; 

FIG. 30C is a view showing the differential value, 
in neighboring directions, of the reference image 
data; 

FIG. 31 A is a view showing the subtraction re- 
sult, in the edge direction, of the inspection 
image data without a defect; 
FIG. 31 B is a view showing the subtraction re- 
sult of surrounding pixels of the inspection im- 
age data without a defect; 

FIG. 31 C is a view showing the subtraction 
result, in neighboring directions, of the inspec- 
tion image data without a defect; 
FIG. 32A is a view showing the subtraction re- 
sult, in the edge direction, of the inspection 
image data with a defect; 

FIG. 32B is a view showing the subtraction re- 
sult of surrounding pixels of the inspection im- 
age data with a defect; 

FIG. 32C is a view showing the subtraction 
result, in neighboring directions, of the inspec- 
tion image data with a defect; 
FIG. 33A is a view showing the edge direction of 
the inspection image data without a defect; 
FIG. 33B is a view showing the edge direction of 
the inspection image data with a defect; 
FIG. 34A is a view showing the differential value 
of the inspection image data without a defect; 
FIG. 34B is a view showing the differential value 
of the inspection image data with a defect; 
FIG. 35A is a view showing the differential value, 
in the edge direction, of the reference image 
data; 

FIG. 35B is a view showing the differential value 
of surrounding pixels of the reference image 
data; 

FIG. 35C is a view showing the differential value, 
in neighboring directions, of the reference image 
data; 

FIG. 36 is a view showing the subtraction result 
without a defect; 

FIG. 37 is a view showing the subtraction result 
with a defect; 

FIG. 38A is a view showing other differential 

operators in the x direction; 

FIG. 38B is a view showing other differential 

operators in the y direction; 

FIG. 38C is a view showing other differential 

operators in the +45* direction; and 

FIG. 38D other differential operators in the -45" 

direction. 

Prior to the description of an embodiment of 
the present invention, a pattern defect inspection 
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apparatus as a premise of the embodiment will be 
described below. 

FIG. 1 1 is a block diagram showing the ar- 
rangement of the pattern defect inspection appara- 
5 tus. The same reference numerals in FIG. 11 de- 
note the same parts as in the pattern defect in- 
spection apparatus shown in FIG. 1. Therefore, a 
detailed description of repetitive portions will be 
omitted. 

io An image signal output from an image sensor 

(for instance scan) 1 is converted into multi- value 
data by an A/D converter 2, and thereafter, the 
multi-value data is spatially differentiated by a first 
differential circuit 3 using differential operators in 

75 the x, y, and ±45 ° directions. 

On the other hand, a design pattern output 
from a design data memory 5 is converted into 
reference image data by a reference image gener- 
ator 6, and thereafter, the reference image data is 

20 spatially converted by a second differential circuit 7 
using differential operators in the x, y, and ±45° 
directions. 

A minimum value direction detection circuit 8 
detects a differential direction corresponding to a 
25 differential value having the smallest absolute value 
of the differential values output from the second 
differential circuit 7, and sends this differential val- 
ue to first and second selectors 30 and 31 . 

On the other hand, the reference image data 
30 output from the reference image generator 6 is 
supplied to a third differential circuit 32. 

Corresponding to the input timing of one pixel 
data of interest to the second differential circuit 7, 
the third differential circuit 32 fetches 3x3, i.e., a 
35 total of nine pixel data forming a local area includ- 
ing the pixel data of interest at the center. 

The third differential circuit 32 calculates dif- 
ferential values for eight surrounding pixel data 
other than the central pixel data of the fetched pixel 
40 data using the differential operators in the four 
directions. 

The eight differential values in each direction 
output from the third differential circuit 32 are input 
to a maximum value detection circuit 33. 

45 The maximum value detection circuit 33 de- 

tects a maximum differential value, i.e., a differen- 
tial value having the largest absolute value in each 
direction from the eight differential values in each 
direction output from the third differential circuit 32, 

so and supplies these four maximum differential val- 
ues to the second selector 31 . 

The first selector 30 selects a differential value 
in the differential direction designated by the mini- 
mum value direction detection circuit 8 from the 

55 differential values in the four directions output from 
the first differential circuit 3, and supplies the se- 
lected value to a subtraction circuit 34. 
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The second selector 31 selects a maximum 
differential value in the differential direction des- 
ignated by the minimum value direction detection 
circuit 8 from the four maximum differential values 
input from the maximum value detection circuit 33, 
and supplies the selected value to the subtraction 
circuit 34. 

The subtraction circuit 34 calculates the dif- 
ference between the differential value from the first 
selector 30 and the maximum differential value 
from the second selector 31, and supplies the 
difference as a difference differential value to a 
negative value cancel circuit 35. 

The negative value cancel circuit 35 replaces 
only a negative difference differential value by "0", 
and supplies the difference differential value to a 
defect judge circuit 36. 

When the difference differential value exceeds 
a predetermined threshold value, the defect judge 
circuit 36 determines that pixel data corresponding 
to the difference differential value is a pattern de- 
fect. 

An operation after the first to third differential 
circuits 3, 7, and 32 will be described in detail 
below. 

An operation for central pixel data "5" in a 
local area 23 of an edge portion at a position A 
shown in FIG. 3 is as follows. 

The first differential circuit 3 fetches, e.g., nine 
pixel data in the local area 23 including the central 
pixel data "5" at the center. 

The first differential circuit 3 calculates differen- 
tial values, in the four directions, of the central pixel 
data "5". 

The first differential circuit 3 performs spatial 
differentiation using differential operators Da to Dd 
in the x, y, and ±45 • directions. 

Therefore, differential values 37a to 37d, in the 
four directions, for the central pixel data "5" are 
respectively "0", "4", "4", and "-4", as shown in 
FIG. 12. 

Similarly, the second differential circuit 7 spa- 
tially differentiates pixel data of reference image 
data using the differential operators Da to Dd in the 
four directions to obtain differential values. 

The absolute values of differential values 37a 
to 37d at the position A in the reference image data 
shown in FIG. 12 are respectively "0", "4", "4", 
and "4". The minimum value is "0\ 

The minimum value direction detection circuit 8 
supplies the x direction corresponding to the dif- 
ferential value 37a having the minimum value "O* 1 
to the first and second selectors 30 and 31. 

The third differential circuit 21 calculates dif- 
ferential values 38 in the four directions for each of 
the eight pixel data spatially differentiated by the 
second differential circuit 7. 



All the differential values in the x direction for 
eight surrounding pixel data around the central 
pixel data n 5" at the position A are "0", as shown 
in FIG. 12. 

5 The differential values in the y direction include 

six "5 n s and two "2"s. The differential values in the 
+ 45* direction include six M 5 rt s and two "4"s The 
differential values in the -45* direction include six 
n -5"s and two M -4"s. 

10 Therefore, the maximum values of the absolute 

values of these differential values in the four direc- 
tions are respectively "0", "5", "5", and "5". 

Since the minimum value direction detection 
circuit 8 selects the x direction for the edge portion 

75 at the position A, the maximum differential value 
selected by the second selector 31 is "0" shown in 
FIG. 13A. 

If neither a defect nor a coordinate shift are 
present, the first selector 30 selects the value n 0 n 
20 of the differential value 37a in the x direction for 
the central pixel data "5". 

As a result, the subtraction circuit 34 outputs a 
difference differential value "0". In this case, the 
defect judge circuit 36 does not detect any pattern 
25 defect, as a matter of course. 

FIG. 13B shows the processing result for cen- 
tral pixel data "6" in a corner portion at a position 

B. In this case, the minimum value direction of the 
differential values in the four directions of the pixel 

30 data "6" is the -45° direction. 

A differential value of pixel data in the -45* 
direction becomes "0 rt , and eight differential values 
in the -45° direction of surrounding pixel data 
include values "4", "3", "2", and "0". Therefore, 
35 the maximum value is "4". 

In this case, a difference differential value out- 
put from the subtraction circuit 34 is "-4", and the 
negative cancel circuit 35 replaces the difference 
differential value "-4" by "0". 
40 Therefore, the defect judge circuit 36 does not 

detect any pattern defect. 

FIG. 13C shows the processing result for cen- 
tral pixel data "0" in a uniform portion at a position 

C. In this case as well, no pattern defect is output. 
45 A case will be explained below wherein no 

defect is present, and the position or pattern co- 
ordinates of inspection image data and reference 
image data are shifted from each other by about 
one pixel. 

so The minimum value direction detection circuit 8 

detects the x direction for the edge portion at the 
position A shown in FIG. 3. The subtraction circuit 
34 receives a differential value "0" in the x direc- 
tion from the first differential circuit 3. 

55 Similarly, a differential value in the x direction 

of surrounding pixel data becomes "0", and no 
pattern defect is output. 
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Then, a differential value in the -45' direction 
for central pixel data in the corner portion at the 
position B shown in FIG. 3 in the inspection image 
data becomes "0". Differential values in other di- 
rections have constant values determined by the 
differential directions. 

On the other hand, central pixel data in the 
reference image data does not correspond to the 
central pixel data in the inspection image data, and 
is shifted by one pixel from it. 

Therefore, a differential value in the -45 0 direc- 
tion for the shifted pixel data exhibits a value which 
is not "0". 

As a result, the minimum value direction detec- 
tion circuit 8 does not always designate the -45* 
differential direction. Therefore, the first selector 30 
does not always select the differential value "0" in 
the -45* direction. 

On the other hand, in the reference image data, 
the minimum value direction detection circuit 8 
detects a value at least larger than the differential 
value output from the first selector 30. As a result, 
the subtraction circuit 34 calculates the difference 
between the values from the selectors 30 and 31. 
With this calculation, the differential value output 
from the first selector 30 is canceled. Therefore, no 
defect is output as shown in FIG. 14A. 

A case will be explained below wherein a de- 
fect is present, and the position or pattern coordi- 
nates of inspection image data and reference im- 
age data are shifted from each other by about one 
pixel. 

For the local area 23 of the edge portion at the 
position A, the first differential circuit 3 differen- 
tiates inspection image data, and outputs a dif- 
ferential value in the x direction corresponding to 
the defect. 

In contrast to this, the second differential circuit 
7 outputs a differential value "0" in the x direction 
of surrounding pixel data around the central pixel 
data. 

As a result, the subtraction circuit 34 outputs a 
difference differential value corresponding to the 
defect scale. The defect judge circuit 36 outputs a 
pattern defect. 

The differential direction designated by the 
minimum value direction detection circuit 8 for the 
local area 23 of the corner portion at the position B, 
is not uniquely determined. 

The first differential circuit 3 outputs differential 
values corresponding to the defect in the respec- 
tive differential direction including the -45* direc- 
tion. 

The first selector 30 selects a differential value 
corresponding to the defect. 

On the other hand, values in the respective 
differential directions obtained by differentiating the 
surrounding pixels in the reference image data by 



the third differential circuit 32 do not correspond to 
the values caused by the presence of the defect at 
all. Therefore, the subtraction circuit 34 detects a 
defect Gf, as shown in FIG. 14B. 

5 Therefore, even when the coordinate system of 

the inspection image data and the reference image 
data are slightly shifted from each other, the defect 
Gf can be prevented from including a pseudo de- 
fect Gc caused by the shift, and only an actual 

io defect can be reliably detected with high accuracy. 

An embodiment of the present invention will be 
described below. 

FIG. 15 is a block diagram showing the ar- 
rangement of a pattern defect detection apparatus. 

75 An image sensor 40 comprises a line sensor. 

The image sensor 40 is connected to a plural 
direction differential circuit 42 via an A/D converter 
41. 

The plural direction differential circuit 42 has 
20 differential operators in the x, y, +45°, and -45° 
directions, and has a function of executing differen- 
tial processing of inspection image data using 
these differential operators. 

Note that this plural direction differential circuit 
25 42 has differential operators in +22.5°, +67.5°, 
-22.5 and -67.5° directions shown in FIG. 16 in 
addition to the above-mentioned differential oper- 
ators. 

Therefore, the plural direction differential circuit 

30 42 has a function of executing differential process- 
ing of inspection image data in the four or eight 
directions of these differential operators. 

A maximum value direction detection circuit 43 
has a function of receiving processing results in the 

35 respective differential directions from the plural di- 
rection differential circuit 42, detecting the differen- 
tial direction of a differential value having a maxi- 
mum value from the received differential values 
(absolute values) in the respective differential direc- 

40 tions, and supplying the detected differential direc- 
tion to a selector 44. 

On the other hand, a reference data generation 
circuit 45 has a function of generating reference 
image data corresponding to inspection image data 

45 obtained by an image pickup operation of the im- 
age sensor on the basis of design data of pattern 
data in synchronism with position data. 

An edge direction detection circuit 46 has a 
function of detecting edge directions of the pattern 

50 in the reference image data in units of pixels, and 
supplying the detection results to the selector 44. 

When the pattern edge direction is indefinite, 
the edge direction detection circuit 46 has a func- 
tion of sending a message indicating that the direc- 

55 tion is indefinite to the selector 44. 

The selector 44 has a function of normally 
selecting the differential direction detected by the 
edge direction detection circuit 46 as a pattern 
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edge direction, and selecting the differential direc- 
tion detected by the maximum value direction de- 
tection circuit 43 upon reception of a message 
indicating that the direction is indefinite. 

A fust edge direction differential circuit 47 has 
a function of receiving the differential direction as 
the pattern edge direction selected by the selector 
44, and executing differential processing of inspec- 
tion image data from the A/D converter 41 using 
the received differential direction so as to calculate 
the absolute value of the differential value. 

On the other hand, a second edge direction 
differential circuit 48 has a function of receiving the 
differentia] direction as the pattern edge direction 
selected by the selector 44, and executing differen- 
tial processing of reference image data using the 
received differential direction so as to calculate the 
absolute value of the differential value. 

A differential processing means 50 has a func- 
tion of executing differential processing of sur- 
rounding pixels of the reference image data using 
differential operators in a direction along the pat- 
tern edge direction. 

Also, the differential processing means 50 has 
a function of executing differential processing of 
the reference image data using differential oper- 
ators in directions neighboring to the pattern edge 
direction. 

More specifically, the differential processing 
means 50 has functions of a surrounding pixel 
edge direction differential circuit 51, a first maxi- 
mum value detection circuit 52, a neighboring di- 
rection differential circuit 53, and a second maxi- 
mum value detection circuit 54. 

The surrounding pixel edge direction differen- 
tial circuit 51 has a function of executing differential 
processing of reference image data for surrounding 
pixels around a pixel, for which a differential value 
is to be calculated, using differential operators in a 
direction along the pattern edge direction detected 
by the edge direction detection circuit 46. 

The first maximum value detection circuit 52 
has a function of detecting a maximum absolute 
value from the differential values of the surrounding 
pixels calculated by the surrounding pixel edge 
direction differential circuit 51 . 

The neighboring direction differential circuit 53 
has a function of executing differential processing 
of reference image data using differential operators 
in directions neighboring the pattern edge direction 
detected by the edge direction detection circuit 46. 

The neighboring direction differential circuit 53 
has a function of executing differential processing 
of reference image data using differential operators 
in the x and y directions which are orthogonal to 
each other, and the ±45', ±22.5 \ and ±67.5* 
directions with respect to the x direction. 



The second maximum value detection circuit 
54 has a function of detecting a maximum value 
from the absolute values of the differential values 
calculated by the neighboring direction differential 

5 circuit 53. 

The output terminals of the edge direction dif- 
ferential circuit 48 and the first and second maxi- 
mum value detection circuits 52 and 54 are con- 
nected to a subtraction circuit 56 via a select 

io switch 55. 

The subtraction circuit 56 has a function of 
calculating the differences, in units of pixels, be- 
tween the inspection image data differentiated by 
the edge direction differential circuit 47, and dif- 

75 ferential data from one of the edge direction dif- 
ferential circuit 48, and the first and second maxi- 
mum value detection circuits 52 and 54, which is 
selected by the select switch 55. 

A defect judge circuit 57 has a function of 

20 comparing difference values in units of pixels from 
the subtraction circuit 56 with a predetermined 
threshold value, and determining, to be a defect, a 
pixel corresponding to the difference value in units 
of pixels, which exceeds the threshold value. 

25 The operation of the apparatus with the above- 

mentioned arrangement will be described below. 

The reference data generation circuit 45 gen- 
erates reference image data on the basis of design 
data of pattern data. 

30 FIG. 17 is a view showing the reference image 

data. Local areas, edge, comer, and uniform por- 
tions a, b, and c are set. Each of these edge, 
corner, and uniform portions a, b, and c is defined 
by 7 x 7 pixels, as shown in FIG. 18. In each of the 

35 edge, corner, and uniform portions a, b, and c, a 
dark portion is indicated by a density level "0", and 
a light portion is indicated by a density level "10". 

In this manner, the reference image data is 
data generated based on the design data, and has 

40 smooth density gradation at an edge. 

On the other hand, the image sensor 40 con- 
tinuously picks up an image of an object to be 
inspected, and outputs its image signal. The image 
signal is converted into digital inspection image 

45 data corresponding to 1 1 density levels by the A/D 
converter 41 . 

FIG. 19 is a view showing inspection image 
data without a defect. Each of the edge, corner, 
and uniform portions a, b, and c in the inspection 

so image data is defined by 5 x 5 pixels, as shown in 
FIG. 20. 

FIG. 21 is a view showing inspection image 
data with a defect. Each of the edge, corner, and 
uniform portions a, b, and c in the inspection image 
55 data is defined by 5 x 5 pixels, as shown in FIG. 
22. 

Note that a noise component of about density 
level "1 " is superposed on these inspection image 
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data due to, e.g., a sampling error upon input of an 
image using the image sensor 40. 

Image data of each corner portion b in these 
inspection image data is shifted by one pixel from 
image data of the corner portion b shown in FIG. 5 
18 in the -y direction. 

When these reference and inspection image 
data are obtained, the reference image data is 
supplied to the edge direction detection circuit 46. 

The edge direction detection circuit 46 per- io 
forms differential processing of the reference im- 
age data in the x, y, +45*, and -45° directions, 
and detects the differential direction of a minimum 
differential value from the calculated differential val- 
ues, is 
(a) Processing for the edge portions a in the 
reference and inspection image data will be 
described below. 

The pattern edge direction in the edge por- 
tion a of the reference image data corresponds 20 
to the differential direction of the x direction, as 
shown in FIG. 23. 

Therefore, the selector 44 selects the dif- 
ferential direction x, and sends it to the first and 
second edge direction differential circuits 47 and 25 
48, the surrounding pixel edge direction differen- 
tial circuit 51, and the neighboring direction dif- 
ferential circuit 53. 

The first edge direction differential circuit 47 
executes differential processing of the inspec- 30 
tion image data using differentia! operators in 
the x direction. 

When pixels in the edge portion a without a 
defect shown in FIG. 20 are differentiated in the 
x direction, the absolute values of differential 35 
processing values without a defect shown in 
FIG. 24A are obtained. 

When pixels in the edge portion a with a 
defect shown in FIG. 22 are differentiated in the 
x direction, the absolute values of differential 40 
processing values with a defect shown in FIG. 
24B are obtained. 

The inspection image data differentiated by 
the first edge direction differential circuit 47 is 
supplied to the subtraction circuit 56. 45 

On the other hand, the second edge direc- 
tion differential circuit 48 executes differential 
processing of the edge portion a of the refer- 
ence image data using differential operators in 
the x direction shown in FIG. 2A so as to obtain 50 
the absolute values of the differential values. 
The differential result is as shown in FIG. 25A. 

More specifically, in the edge portion a of 
the reference image data, pixel data, in the x 
direction, above central pixel data "5" have val- 55 

ues "8", T, T as shown in FIG. 18. 

Pixel data in the x direction passing the 
central pixel data "5" have values "5", "5", 



n tZ" 

\J f * * - * 

Pixel data, in the x direction, below the 
central pixel data "5" have values "2", "2", 

no** 

J_ a • • • » 

Therefore, all differential values, in the x 
direction, for these pixel data are "0", as shown 
in FIG. 25A. 

The surrounding pixel edge direction dif- 
ferential circuit 51 executes differential process- 
ing of surrounding pixels around the central 
pixel data "5" in the edge portion a. 

First, differential values, in the x direction, 
for surrounding pixels around upper left pixel 
data "8" with respect to the central pixel data 
"5" in the edge portion a shown in FIG. 18 are 
calculated. 

The surrounding pixels around the pixel data 
"8" are, in turn from the upper left pixel in the 
clockwise direction, "10", "10", "10", "8, "5", 
"5", "5", and "8", and the upper left pixel "10" 
appears again. 

Therefore, the surrounding pixel edge direc- 
tion differential circuit 51 calculates differential 
values, in the x direction, of these surrounding 
pixels. 

The maximum value detection circuit 52 de- 
tects a maximum value "0" from the absolute 
values of the differential values in the x direction 
calculated by the surrounding pixel edge direc- 
tion differential circuit 51. 

The maximum value "0" detected by the 
maximum value detection circuit 52 becomes a 
differential value for the upper left pixel data "8" 
with respect to the central pixel data "5" in the 
edge portion a. 

Then, differential values, in the x direction, 
for surrounding pixels around upper pixel data 
"8" of the central pixel data "5" in the edge 
portion a are calculated. 

The surrounding pixels around this pixel 
data "8" are, in turn from the upper left pixel in 
the clockwise direction, "10", "10", "10". n 8, 
"5", "5", "5", and "8", and the upper left pixel 
"10" appears again. 

Therefore, the surrounding pixel edge direc- 
tion differential circuit 51 calculates differential 
values, in the x direction, of these surrounding 
pixels. 

The maximum value detection circuit 52 de- 
tects a maximum value "0" from the absolute 
values of the differential values in the x direction 
calculated by the surrounding pixel edge direc- 
tion differential circuit 51 . 

The maximum value "0" detected by the 
maximum value detection circuit 52 becomes a 
differential value for the upper pixel data "8" of 
the central pixel data "5" in the edge portion a. 
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Similarly, the surrounding pixel edge direc- 
tion differential circuit 51 calculates differential 
values for each of surrounding pixels around the 
central pixel data "5 W in the edge portion a. 

FIG. 25B shows the differential results of the 5 
surrounding pixel edge direction differential cir- 
cuit 51 . 

The neighboring direction differential circuit 
53 executes differential processing of the refer- 
ence image data using differential operators in 10 
directions neighboring the x direction as the 
pattern edge direction, i.e., in the ±22.5° direc- 
tions shown in FIG. 16. 

More specifically, differential values, in the 
+ 22.5 • direction, for the upper left, upper, and 75 
upper right pixel data "8" with respect to the 
central pixel data "5" of the reference image 
data are "2". Digits below the decimal point are 
dropped. 

Similarly, differential values, in the -22.5° 20 
direction, for the upper left, upper, and upper 
right pixel data "8" are "-2". 

Therefore, the maximum value detection cir- 
cuit 54 detects a maximum value "2" from the 

absolute values of the differential values "2", 25 
„ 2 „ „ 2 „ „ -2 „ „_ 2 „ ^ „. 2 „ Qf the upper |eft 

upper, and upper right pixel data "8" with re- 
spect to the central pixel data "5" in the refer- 
ence image data. 

On the other hand, differential values, in the 30 
+ 22.5° direction, for the left, central, and right 
pixel data "5" with respect to the central pixel 
data n 5" in the reference image data are "3". 

Similarly, differential values, in the -22.5° 
direction, for the left, central, and right pixel data 35 
"5" are "-3". 

Therefore, the maximum value detection cir- 
cuit 54 detects a maximum value "3" from the 

absolute values of the differential values "3", 

« 3 „ „ 3 „ «_ 3 „ „_ 3 „ and „_3„ Qf the |eft centra , 40 

and right pixel data "5" with respect to the 
central pixel data "5" in the reference image 
data. 

Also, differential values, in the +22.5x direc- 
tion, for the lower left, lower, and lower right 45 
pixel data "2" with respect to the central pixel 
data "5" in the reference image data are "2". 

Similarly, differential values, in the -22.5° 
direction, for the lower left, lower, and lower 
right pixel data "2" are "-2". 50 

Therefore, the maximum value detection cir- 
cuit 54 detects a maximum value "2" from the 
absolute values of the differential values "2", 
M 2", "2", "-2", "-2", and "-2" of the lower left, 
lower, and lower right pixel data "2" with re- 55 
spect to the central pixel data "5" in the refer- 
ence image data. 



As a result, the differential values, in the 
neighboring directions, for the reference image 
data are obtained, as shown in FIG. 25C. 

These differential results of the second edge 
direction differential circuit 48, the surrounding 
pixel edge direction differential circuit 51, and 
the neighboring direction differential circuit 53 
are supplied to the subtraction circuit 56 via the 
select switch 55. 

The subtraction circuit 56 subtracts the dif- 
ferential results (FIGS. 25A, 25B, and 25C) of 
each of the second edge direction differential 
circuit 48, the surrounding pixel edge direction 
differential circuit 51, and the neighboring direc- 
tion differential circuit 53 from the differential 
results (FIG. 24A or 24B) of the first edge direc- 
tion differential circuit 47. 

The subtraction results are supplied to the 
defect judge circuit 57. 

When a negative value is obtained as a 
result of the subtraction, the corresponding sub- 
traction result is set to be "0". 

For example, when the differential values in 
the edge direction, the differential values in the 
surrounding pixel edge direction, and the dif- 
ferential values in the neighboring directions 
shown in FIGS. 25A, 25B, and 25C are respec- 
tively subtracted from the differential values of 
the inspection image data without a defect 
shown in FIG. 24A, the subtraction results are as 
shown in FIGS. 26A, 26B, and 26C, respectively. 

On the other hand, when the differential 
values in the edge direction, the differential val- 
ues in the surrounding pixel edge direction, and 
the differential values in the neighboring direc- 
tions shown in FIGS. 25A, 25B, and 25C are 
respectively subtracted from the differential val- 
ues of the inspection image data with a defect 
shown in FIG. 24B, the subtraction results are as 
shown in FIGS. 27A, 27B, and 27C, respectively. 

More specifically, the subtraction results 
shown in FIGS. 26A to 26C and FIGS. 27A to 
27C represent the differences between the in- 
spection image data and the reference image 
data. 

Therefore, pixel portions which do not co- 
incide with each other between these image 
data are detected as a defect portion. 

When the results from the subtraction circuit 
56 are compared with a threshold value by the 
defect judge circuit 57, a pattern defect is dis- 
criminated. 

(b) Processing for the corner portions b in the 
reference and inspection image data will be 
described below. 

The edge direction detection circuit 46 de- 
tects pattern edge directions in the corner por- 
tion b in the reference image data, as shown in 
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FIG. 28. 

Therefore, the selector 44 selects differential 
directions in units of pixels, and sends them to 
the first and second, edge direction differential 
circuits 47 and 48. the surrounding pixel edge 
direction differential circuit 51 , and the neighbor- 
ing direction differential circuit 53. 

In this case, when a plurality of edge direc- 
tions detected by the edge direction detection 
circuit 46 correspond to a minimum differential 
value for a certain pixel, the selector 44 deter- 
mines one edge direction in accordance with the 
priority order of the y direction, x direction -45 • 
direction, and + 45 * direction. 

The first edge direction differential circuit 47 
executes differential processing of the inspec- 
tion image data using differential operators in 
the detected differential direction. 

More specifically, when pixel data in the 
corner portion b without a defect shown in FIG. 
20 are differentiated in units of pixels, the ab- 
solute values of differential processing results 
without a defect shown in FIG. 29A are obtained. 

On the other hand, when pixel data in the 
corner portion b with a defect shown in FIG. 22 
are differentiated in units of pixels, the absolute 
values of differential processing results with a 
defect shown in FIG. 29B are obtained. 

The differential results of the first edge di- 
rection differential circuit 47 are supplied to the 
subtraction circuit 56. 

On the other hand, the second edge direc- 
tion differential circuit 48 executes differentia! 
processing of pixel data in the corner portion b 
of the reference image data using differential 
operators in the differential directions detected 
by the edge direction detection circuit 46 so as 
to obtain the absolute values of the differential 
values. The differential results are as shown in 
FIG. 30A. 

The surrounding pixel edge direction dif- 
ferential circuit 51 executes differential process- 
ing of surrounding pixels in the corner portion b 
of the reference image data in units of pixels in 
the same manner as described above. 

The maximum value detection circuit 52 de- 
tects a maximum value from the absolute values 
of the differential values of the surrounding pixel 
edge direction differential circuit 51 . 

FIG. 30B shows the detection result. 

The neighboring direction differential circuit 
53 executes differential processing of the refer- 
ence image data in the edge direction and di- 
rections neighboring the edge direction in the 
same manner as described above, and the next 
maximum value detection circuit 31 detects a 
maximum absolute value. FIG. 30C shows the 
detection result. 



The differential results of the second edge 
direction differential circuit 48, the surrounding 
pixel edge direction differential circuit 51, and 
the neighboring direction differential circuit 53 

5 are supplied to the subtraction circuit 56 via the 

select switch 55. 

The subtraction circuit 56 subtracts the dif- 
ferential results (FIGS. 30A, 30B, and 30C) of 
each of the second edge direction differential 

io circuit 48, the surrounding pixel edge direction 
differential circuit 51, and the neighboring direc- 
tion differential circuit 53 from the inspection 
image data (FIG. 29A or 29B) differentiated by 
the first edge direction differential circuit 47. 

75 FIGS. 31 A, 31 B, and 31 C respectively show 

the results obtained by subtracting the differen- 
tial results (FIGS. 30A, 30B, and 30C) of each of 
the second edge direction differential circuit 48, 
the surrounding pixel edge direction differential 

20 circuit 51 , and the neighboring direction differen- 
tial circuit 53 from the inspection image data 
without a defect (FIG. 29A) differentiated by the 
first edge direction differential circuit 47. 

FIGS. 32A, 32B, and 32C respectively show 

25 the results obtained by subtracting the differen- 
tial results (FIGS. 30A, 30B, and 30C) of each of 
the second edge direction differential circuit 48, 
the surrounding pixel edge direction differential 
circuit 51 , and the neighboring direction differen- 

30 tial circuit 53 from the inspection image data 
with a defect (FIG. 29B) differentiated by the 
first edge direction differential circuit 47. 

These subtraction results are supplied to the 
defect judge circuit 57. 

35 The defect judge circuit 57 discriminates a 

pattern defect by comparing the subtraction re- 
sults from the subtraction circuit 56 with a 
threshold value. 

(c) Processing for the uniform portions c in the 
40 reference and inspection image data will be 
described below. 
When an object to be inspection has no defect, 
the edge direction detection circuit 46 detects pat- 
tern edge directions in the uniform portion c in the 
45 reference image data, as shown in FIG. 33A. In this 
case, since the density level is uniform, the direc- 
tion becomes indefinite. 

When an object to be inspection has a defect, 
the edge direction detection circuit 46 detects pat- 
so tern edge directions in the uniform portion c in the 
reference image data, as shown in FIG. 33B. 

The plural direction differential circuit 42 ex- 
ecutes differential processing of inspection image 
data using differential operators in the x, y, +45 # , 
55 and -45 • directions. 

Therefore, the selector 44 selects a differential 
direction exhibiting a maximum value from the dif- 
ferential values in the edge directions detected by 
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the maximum value direction detection circuit 43. 

The first edge direction differential circuit 47 
executes differential processing of the inspection 
image data using the differential operators in the 
detected differential direction. 

More specifically, when pixel data in the uni- 
form portion c without a defect shown in FIG. 20 
are differentiated in units of pixels, the absolute 
values of differential processing results without a 
defect shown in FIG. 34A are obtained. 

On the other hand, when pixel data in the 
uniform portion c with a defect shown in FIG. 22 
are differentiated in units of pixels, the absolute 
values of differential processing results without a 
defect shown in FIG. 34B are obtained. 

The second edge direction differential circuit 
48, the surrounding pixel edge direction differential 
circuit 51, and the neighboring direction differential 
circuit 53 respectively execute differential process- 
ing of reference image data in accordance with the 
selected edge directions. 

The processing results of all pixels are "0", as 
shown in FIGS. 35A, 35B, and 35C. 

Therefore, the subtraction results of the sub- 
traction circuit 56 become the same as the dif- 
ferential values of the inspection image data, as 
shown in FIGS. 36 and 37. 

In this manner, the defect judge circuit 57 
discriminates a pattern defect by comparing the 
subtraction results from the subtraction circuit 56 
with a threshold value. 

As described above, according to the embodi- 
ment, a pattern defect can be reliably detected by 
comparing the reference and inspection image 
data. 

In particular, since the apparatus has a function 
of detecting a maximum value by executing dif- 
ferential processing of the reference image data for 
each pixel and surrounding pixels around the pixel, 
and detecting a maximum value by executing dif- 
ferential processing of the reference image data in 
the edge direction and in directions neighboring the 
edge direction, even when the edge, corner, and 
uniform portions a, b, and c suffer a coordinate 
position shift from the pattern, a pattern defect can 
be detected with high accuracy in these portions. 

Note that the present invention is not limited to 
the above embodiment, and various changes and 
modifications may be made within the spirit and 
scope of the invention. 

For example, the subtraction circuit 56 may 
calculate the difference between the inspection im- 
age data differentiated by the first edge direction 
differential circuit 47 and differential image data 
obtained from at least one of the second edge 
direction differential circuit 48, the surrounding 
pixel edge direction differential processing circuit 
51, and the neighboring direction differential circuit 



53. 

Note that as differential operators, differential 
values in the x, y, and ±45' directions may be 
obtained using Sobel operators, as shown in, e.g., 
5 FIGS. 38A to 38D. 

Claims 

1. A pattern defect inspection method character- 
10 ized by comprising: 

the first step of detecting a pattern edge 
direction in reference image data used for de- 
tecting a pattern defect of an object to be 
inspected; 

is the second step of executing differential 

processing of the reference image data using a 
differential operator in a direction along the 
detected pattern edge direction, and executing 
differential processing of inspection image data 

20 obtained by picking up an image of the object 

to be inspected using a differential operator in 
the direction along the detected pattern edge 
direction; and 

the third step of comparing differential data 

25 obtained by the differential processing in the 

second step with the inspection image data 
and detecting a pattern defect on the object to 
be inspected on the basis of a difference be- 
tween the said data. 

30 

2. A pattern defect inspection apparatus char- 
acterized by comprising: 

image pickup means (40, 41) for picking 
up an image of an object to be inspected to 
35 generate inspection image data; 

reference image generation beans (45) for 
generating reference image data for comparing 
with the inspecting pattern on the object; 

edge direction detection means (46) for 
40 detecting a pattern edge direction in the refer- 

ence image data; 

first edge direction differential means (47) 
for executing differential processing of the in- 
spection image data using a differential oper- 
as ator in a direction along the pattern edge direc- 
tion; 

second edge direction differential means 
(48) for executing differential processing of the 
reference image data using the differential op- 
50 erator in the direction along the pattern edge 

direction; 

differential processing means (50) for ex- 
ecuting differential processing of surrounding 
pixels in the reference image data using the 
55 differential operator in the direction along the 

pattern edge direction, and executing differen- 
tial processing of the reference image data 
using differential operators in directions neigh- 
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boring the pattern edge direction; and 

discrimination means (56, 57) for detecting 
a pattern defect of the object to be inspected 
on the basis of a difference between difference 
data obtained by said first edge direction dif- 
ferential means, and differential data obtained 
by said second edge direction differential 
means or at least one of differential data ob- 
tained by said differential processing means. 

3. An apparatus according to claim 2, character- 
ized in that said edge direction detection 
means (46) has a function of executing dif- 
ferential processing of the reference image 
data using differential operators in x and y 
directions which are orthogonal to each other, 
and ±45* directions with respect to the x di- 
rection, and determining a differential direction 
corresponding to a minimum value of differen- 
tial values obtained by the differential process- 
ing as the pattern edge direction. 

4. An apparatus according to claim 2, character- 
ized in that said differential processing means 
(50) comprises: 

a surrounding pixel edge direction differen- 
tial circuit (51) for executing differential pro- 
cessing of the reference image data for pixels 
around a pixel for which a differential value is 
to be calculated using the differential operator 
in the direction along the pattern edge direc- 
tion detected by said edge direction detection 
means; and 

a first maximum value detection circuit 

(52) for detecting a maximum value from ab- 
solute values of differential values of the sur- 
rounding pixels calculated by said surrounding 
pixel edge direction differential circuit. 

5. An apparatus according to claim 2, character- 
ized in that said differential processing means 
(50) comprises: 

a neighboring direction differential circuit 

(53) for executing differential processing of the 
reference image data using differential oper- 
ators in directions neighboring the pattern 
edge direction detected by said edge direction 
detection means; and 

a second maximum value detection circuit 

(54) for detecting a maximum value from ab- 
solute values of differential values calculated 
by said neighboring direction differential cir- 
cuit. 

6. An apparatus according to claim 2, character- 
ized in that said differential processing means 
comprises: 

a surrounding pixel edge direction differen- 



tial circuit (51) for executing differential pro- 
cessing of the reference image data for pixels 
around a pixel for which a differential value is 
to be calculated using the differential operator 
5 in the direction along the pattern edge direc- 

tion detected by said edge direction detection 
means; 

a first maximum value detection circuit 

(52) for detecting a maximum value from ab- 
10 solute values of differential values of the sur- 
rounding pixels calculated by said surrounding 
pixel edge direction differential circuit; 

a neighboring direction differential circuit 

(53) for executing differential processing of the 
75 reference image data using differential oper- 
ators in directions neighboring the pattern 
edge direction detected by said edge direction 
detection means; and 

a second maximum value detection circuit 
20 (54) for detecting a maximum value from ab- 

solute values of differential values calculated 
by said neighboring direction differential cir- 
cuit. 

25 7. An apparatus according to claim 6, character- 
ized in that said neighboring direction differen- 
tial circuit (53) executes differential processing 
of the reference image data using differential 
operators in the x and y directions which are 

30 orthogonal to each other, and the ±45* direc- 

tions, ±22.5* directions, and ±67.5° directions 
with respect to the x direction. 

8- An apparatus according to claim 2, character- 
35 ized in that said discrimination means (56, 57) 

comprises: 

a subtraction circuit (56) for calculating a 
difference for each pixel between the differ- 
ence data obtained by said first edge direction 
40 differential means, and the differential data ob- 

tained by said second edge direction differen- 
tial means or at least one of the differential 
data obtained by said differential processing 
means; and 

45 a defect judge circuit (57) for comparing 

the difference for each pixel calculated by said 
subtraction circuit with a predetermined thresh- 
old value, and determining, to be a defect, the 
pixel corresponding to the difference for each 

so pixel which exceeds the threshold value. 

9. An apparatus according to claim 2, character- 
ized by further comprising: 

a plural direction differential circuit (42) for 
55 executing differential processing of the inspec- 

tion image data obtained by said image pickup 
means using differential operators in a plurality 
of directions; 
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a maximum value direction detection cir- 
cuit (43) for detecting a differential direction 
corresponding to a maximum value from dif- 
ferential values calculated by said plural direc- 
tion differential circuit; and 5 

a selector (44) for normally selecting the 
differential direction detected by said edge di- 
rection detection means as the edge pattern 
direction and sending the selected direction to 
said first edge direction differential circuit, arid 10 
for, when a message indicating that an edge 
pattern direction is indefinite is received from 
said edge direction detection means, selecting 
the differential direction detected by said maxi- 
mum value direction detection circuit as the 75 
edge pattern direction and sending the se- 
lected direction to said first edge direction 
differential circuit. 



10. An apparatus according to claim 9, character- 20 
ized in that said plural direction differential 
circuit (42) executes differential processing of 

the inspection image data using differential op- 
erators in the x and y directions which are 
orthogonal to each other and the ±45* direc- 25 
tions with respect to the x direction. 

11. An apparatus according to claim 2, character- 
ized in that said image pickup means com- 
prises: 30 

an image sensor (40) for picking up an 
image of the object to be inspected and out- 
putting an image signal of a density level; and 

an AID converter (41) for Converting the 
image signal output from said image sensor 35 
into digital multi-value inspection image data 
corresponding to the density level. 



12. An apparatus according to claim 2, character- 
ized in that said reference image generation 40 
means (45) generates the reference image 
data on the basis of design data of a pattern 
formed on the object to be inspected cor- 
responding to position data of the object to be 
inspected which is to be picked up by said 45 
image pickup means. 



50 
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